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i— i . Abstract 

o- 

This letter derives some new exponential bounds for discrete time, real valued, conditionally symmetric martingales with 
I , bounded jumps. The new bounds are extended to conditionally symmetric sub/ supermartingales, and are compared to some 
^ ■ existing bounds. 
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I. Introduction and Main Results 

Classes of exponential bounds for discrete-time real-valued martingales were extensively studied in the literature 
(see, e.g., (H, 0, (H, @, O-O, 02L and (Bl-GIll). This letter further assumes conditional symmetry of these 
martingales, as it is defined in the following: 

Definition 1: Let {X k , ^A:}fceNo> where No = N U {0}, be a discrete-time and real-valued martingale, and let 



in- c a 



£fc = Xf c —Xf : _i for every k € N designate the jumps of the martingale. Then {X k , Tk}keNo * s ca Ued a conditionally 



(*C) symmetric martingale if, conditioned on Tk-i, the random variable is symmetrically distributed around zero. 

Our goal in this letter is to demonstrate how the assumption of the conditional symmetry improves existing 

^ . exponential inequalities for discrete-time real-valued martingales with bounded increments. Earlier results, serving 

• \ as motivation, appear in Q Section 4] and ITT51 Section 6]. The new exponential bounds are also extended to 

q ■ conditionally symmetric sub or supermartingales, where the construction of these objects is exemplified later in 

CN . this section. The relation of some of the exponential bounds derived in this work with some existing bounds is 

\ discussed later in this letter. Additional results addressing weak-type inequalities, maximal inequalities and ratio 

►> ■ inequalities for conditionally symmetric martingales were derived in Ifl3l , lfT4l and |fT9l . 

% 

■ A. Main Results 

Our main results for conditionally symmetric martingales with bounded jumps are introduced in Theorems [TJ [3] 
and [4] Theorems [2] and [5] are existing bounds, for general martingales without the conditional symmetry assumption, 
that are introduced in connection to the new theorems. Corollaries [T] and [2] provide an extension of the new results 
to conditionally symmetric sub/ supermartingales with bounded jumps. Our first result is the following theorem: 

Theorem 1: Let {X^, J^jfcgNo he a discrete-time real-valued and conditionally symmetric martingale. Assume 
that, for some fixed numbers d, a > 0, the following two requirements are satisfied a.s. 

\X k - X k . x \ < d, Var(X fe |.F fe _ 1 ) = E[{X k - X k ^f \ T k _ x ] < a 2 (1) 

for every k G N. Then, for every a > and n £ N, 

P ( max \X k - X \ > an ) < 2exp(-nE(j,5)) (2) 

\l<k<n J 

where 

7= ^' 6= d (3) 
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and for 7 G (0, 1] and S G [0, 1) 

E(j,6) = fe-ln(l + 7[cosh(x) - l]) (4) 



x=l H ^ J- () 

If 5 > 1, then the probability on the left-hand side of (fj) is zero (so E(<y,6) = +00), and £(7,1) = ln(^). 
Furthermore, the exponent E(j, 5) is asymptotically optimal in the sense that there exists a conditionally symmetric 
martingale, satisfying the conditions in (Q~|) a.s., that attains this exponent in the limit where n — > 00. 

Remark 1: From the above conditions, without any loss of generality, a 2 < d 2 and therefore 7 G (0, 1]. This 
implies that Theorem Q] characterizes the exponent E{^,5) for all values of 7 and 5. 

Theorem Q] should be compared to the statement in ifTTl Theorem 6.1] (see also Corollary 2.4.7]), which does 
not require the conditional symmetry property. It gives the following result: 

Theorem 2: Let {X k , J^jfegNo be a discrete-time real-valued martingale with bounded jumps. Assume that the 
two conditions in dTJ are satisfied a.s. for every fcgN. Then, for every a > and n G N, 



P fmax \X k - X Q \ > ar?J < 2exp (^~ nD (^-^- 
where 7 and 5 are introduced in (O, and 



1 + 7 



(6) 



D(p\\q)±p]n(^+(l-p)]nQ—^, Vp,?€[0,l] (7) 

is the divergence (a.k.a. relative entropy or Kullback-Leibler distance) to the natural base between the two probability 
distributions (p, 1—p) and (q, 1 — q). If S > 1, then the probability on the left-hand side of ((6]) is zero. Furthermore, 
the exponent on the right-hand side of §6§ is asymptotically optimal under the assumptions of this theorem. 

Remark 2: The two exponents in Theorems Q] and [2] are both discontinuous at S = 1. This is consistent with the 
assumption of the bounded jumps that implies that P(|X„ — Xq\ > ndS) is equal to zero if 5 > 1. 

If 5 — > 1~ then, from © and ©, for every 7 G (0, 1], 

lim Eh, 5)= lim \x - m(l + 7(cosh(x) - 1))1 = lnf-V (8) 

On the other hand, the right limit at S = 1 is infinity since £'(7, 5) = +00 for every S > 1. The same discontinuity 
also exists for the exponent in Theorem |2] where the right limit at 5 = 1 is infinity, and the left limit is equal to 

7 ^ mfi + il <9) 



lim D 

\l + 7 



1 + 7/ V 7 

where the last equality follows from (O. A comparison of the limits in (HJ and © is consistent with the improvement 
that is obtained in Theorem Q] as compared to Theorem [2] due to the additional assumption of the conditional 
symmetry that is relevant if 7 G (0, 1). It can be verified that the two exponents coincide if 7 = 1 (which is 
equivalent to removing the constraint on the conditional variance), and their common value is equal to 




(10) 

s > 1 



where h,2(x) = — xlog 2 (x) — (1 — x) log 2 (l — x) for < x < 1 denotes the binary entropy function to the base 2. 

Theorem \T\ provides an improvement over the bound in Theorem |2] for conditionally symmetric martingales with 
bounded jumps. The bounds in Theorems Q] and [2] depend on the conditional variance of the martingale, but they 
do not take into consideration conditional moments of higher orders. The following bound generalizes the bound 
in Theorem [1] but it does not admit in general a closed-form expression. 

Theorem 3: Let {X^, F^keNo be a discrete-time and real- valued conditionally symmetric martingale. Let m G N 
be an even number, and assume that the following conditions hold a.s. for every k G N 

\X k -X k _x\ <d, E[(X k -X k ^) 1 iJVi] < MJj V/G {2,4,..., m} 
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for some d > and non-negative numbers {fi2, Hi, • • • , Mm}- Then, for every a > and n G N, 

\ n 

(11) 



max Xt — Xq\ > an < 2 < min e 

Kfc<n / x>0 



- 1 „2Z 



1+ E J | I y r + 7 m (co S h(x)-l) 



where 

121 = ^, VlGjl,. ..,-). (12) 

We consider in the following a different type of exponential inequalities for conditionally symmetric martingales 
with bounded jumps. 

Theorem 4: Let {X n , T n } n ^ be a discrete-time real- valued and conditionally symmetric martingale. Assume 
that there exists a fixed number d > such that ^ = X& — X^-i < d a.s. for every k G N. Let 

n 

Q n ^^E[^|Jfc_i] (13) 
fc=i 

with Qo — 0, be the predictable quadratic variation of the martingale up to time n. Then, for every z, r > 0, 

max (X k - X ) > z, Q n <r for some n G < exp ( — — ■ C ( —\ \ (14) 
i<fc<n " J \ 2r \r J J 

where 



A 2[nsinh- 1 (n)- ^ n 
C m = = , V« > 0. (15) 

u z 

Theorem |4] should be compared to |8 ( Theorem 1.6] (see also @ Exercise 2.4.21(b)]) that was stated without 
the requirement for the conditional symmetry of the martingale. It provides the following result: 

Theorem 5: Let {X n , Jvi/neNo De a discrete-time real- valued martingale. Assume that there exists a fixed number 
d > such that = X& — Xk~i < d a.s. for every k G N. Then, for every z, r > 0, 

max (X fc - X ) > z, Q n < r for some n G N | < exp f — — • 5 ( — ) ] (16) 
i<k<n " J \ 2r \ r J J 

where 

2[(l + „)ln(l + ,,)-„]_ Vtj>() 



The proof of [8, Theorem 1.6] is modified by using Bennett's inequality for the derivation of the original bound 
in Theorem [5] (without the conditional symmetry requirement). Furthermore, this modified proof serves to derive 
the improved bound in Theorem @] under the conditional symmetry assumption. 

Extension of the inequalities to discrete-time, real-valued, and conditionally symmetric sub/ supermartingales: 

Definition 2: Let {X&, J-fe}fcGN t> e a discrete-time real-valued sub or supermartingale, and rjk = Xfc— E[Xfc|.Ffc_i] 
for every k G N. Then the martingale {Xf-^klkeno * s called, respectively, a conditionally symmetric sub or 
supermartingale if, conditioned on Fk-i, the random variable rjk is symmetrically distributed around zero. 
Remark 3: For martingales, rjk = £fc for every k G N, so we obtain consistency with Definition [TJ 
An extension of Theorem [TJ to conditionally symmetric sub and supermartingales is introduced in the following: 
Corollary 1: Let {X&, Tk}keN De a discrete-time, real-valued and conditionally symmetric supermartingale. 
Assume that, for some constants d, a > 0, the following two requirements are satisfied a.s. 

n k < d, Var(X fc | T h - X ) = E[^ | TW] < a 2 (18) 

for every A; G N. Then, for every a > and n G N, 

pf max (X fc - X ) > an) < exp(-nE(-y,6)) (19) 

\l<fc<n / 
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where 7 and S are denned in ([3]), and E(j,5) is introduced in (01). Alternatively, if {X k , Fk}keN * s a conditionally 
symmetric submartingale, the same bound holds for P(mmi<fc< n (-X"& — Xq) < —an) provided that rj k > —d and 
the second condition in ( fT8l ) hold a.s. for every k G N. If 8 > 1, then these two probabilities are zero. 

The following statement extends Theorem [4] to conditionally symmetric supermartingales. 

Corollary 2: Let {X n , F n } n ^ t> e a discrete-time, real-valued supermartingale. Assume that there exists a fixed 
number d > such that r/ k < d a.s. for every G N. Let {Q n }neN be the predictable quadratic variations of 
the supermartingale, i.e., Q n = Y2k=i ^Vit I ^"fc-l] f° r every n G N with Qo — 0. Then, the result in (fT6l ) holds. 
Furthermore, if the supermartingale is conditionally symmetric, then the improved bound in ([141 ) holds. 

B. Construction of Discrete-Time, Real-Valued and Conditionally Symmetric Sub/ Supermartingales 

Before proving the tightened inequalities for discrete-time conditionally symmetric sub/ supermartingales, it is 
in place to exemplify the construction of these objects. 

Example 1: Let ($7, J 7 , P) be a probability space, and let {U k } keN C L 1 (n,J r ,F) be a sequence of independent 
random variables with zero mean. Let {F k } k >o be the natural filtration of sub cr-algebras of F, where 

Jo = {0,0}, F k = a(U 1 ,...,U k ), V&GN. 

Furthermore, for fcgN, let A k G L°°(r2, F k ^i, P) be an J^-i -measurable random variable with a finite essential 
supremum. Define a new sequence of random variables in L l (Q, F, P) where 

n 

X n = ^A fe C7 ifc , VnGN 
fe=l 

and Xq = 0. Then, {X n , F n } ne ^ is a martingale. Lets assume that the random variables {?7fc}fc g N are symmetrically 
distributed around zero. Note that X n = X n _\ + A n U n where A n is F n -\ -measurable and U n is independent of 
the cr-algebra F n -\ (due to the independence of the random variables Ui, . . . , U n ). It therefore follows that for 
every n G N, given F n -\, the random variable X n is symmetrically distributed around its conditional expectation 
X n -\. Hence, the martingale {X n ,F n } n< =fq is conditionally symmetric. 

Example 2: In continuation to Example [T] let {X n ,F n } n& fq be a martingale, and define Yq = and 

n 

Y n = ^A k (X k -X k _ 1 ), VnGN. 

k=l 

The sequence {Y n ,F n } n £?i is a martingale. If {X^J^jngf^ is a conditionally symmetric martingale then also 
the martingale {Y n ,F n } ne ?t is conditionally symmetric (since Y n = Y n -\ + A n {X n — X n _i), and by assumption 
A n is J^-i-measurable). 

Example 3: In continuation to Example [T] let {C/fc}fc 6 N be independent random variables with a symmetric 
distribution around their expected value, and also assume that K(U k ) < for every k G N. Furthermore, let 
A k G L°°($7, J-fc-i, P), and assume that a.s. vlfc > for every A: G N. Let {X n ,F n } ne ^ a be a martingale as 
defined in Example [T] Note that X n = X n _\ + A n U n where A n is non-negative and J^-i-measurable, and U n 
is independent of F n -\ and symmetrically distributed around its average. This implies that {X n ,F n } n ^ a is a 
conditionally symmetric supermartingale. 

Example 4: In continuation to Examples [2] and [3J let {X n ,F n } n( zfq be a conditionally symmetric supermartingale. 
Define {^ n }neN as in Example |2] where A k is non-negative a.s. and J r / c _ 1 -measurable for every k G N. Then 
{Y n , J-njngNo is a conditionally symmetric supermartingale. 

Example 5: Consider a standard Brownian motion (Wt)t>o- Define, for some T > 0, the discrete-time process 

X n = W nT , F n = a({W t }o<t<nT), VnGN . 

The increments of (Wt)t>o over time intervals [t k -i,t k ] are statistically independent if these intervals do not overlap 
(except of their endpoints), and they are Gaussian distributed with a zero mean and variance t k — t k _i. The random 
variable £ n = X n — X n _\ is therefore statistically independent of F n -\, and it is Gaussian distributed with a zero 
mean and variance T. The martingale {X n , F n } n £?$ is therefore conditionally symmetric. 
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II. Proofs 

A. Combined Proof of Theorems \J} and |2] 

We rely here on the proof of the existing bound that is stated in Theorem |2l for discrete-time real-valued 
martingales with bounded jumps (see ifTTl Theorem 6.1] and [6, Corollary 2.4.7]), and then deviate from this proof 
at the point where the additional property of the conditional symmetry of the martingale is taken into consideration 
for the derivation of the improved exponential inequality in Theorem Q] 

Write X n - X = YJk=iik where £ fc = X k - X k _i for kN. Since {X k - X , -Ffe/fceNo is a martingale, 
h{x) = exp(tx) is a convex function on M for every t G R, and a composition of a convex function with a 
martingale gives a submartingale w.r.t. the same filtration, then {exp(t(X k — Xq)), •7 r fc} fceN is a sub-martingale 
for every t G E. By applying the maximal inequality for submartingales, then for every a > and n G N 

I max (X k — Xq) > an 



\Kk<n 



max exp (t(X k — Xq)) > exp(ant) 

Kk<n 



< exp(— ant) E exjp(t(X n — Xq)^ 
= exp(— ant) E 



Vt > 



ex P ( * ^2 6; 



k=l 



(20) 



Furthermore, 



E 



exp 



/ n 

(*£«> 



E 



E 



E 



k=l 



ex p( ty^Ak 



k=l 



n-l 



n-1 



k=l 



exp I i ^ £fc j E[exp(^ n ) | J" n _i] 



(21) 



where the last transition holds since exp(t Y^ = | Cfc) i s -^n-i-measurable. The proof of Theorem [2] proceeds by 
applying Bennett's inequality (3l (see, e.g., (6l Lemma 2.4.1]) for the conditional law of ^ given the <r-algebra 
Jl-i. Since E^lJ'fc-i] = 0, Var[^ fe | < a 2 and £ k < d a.s. for k G N, then a.s. (see ©) 



E [exp(te fc ) | T k -l] < 



7exp(td) + exp(— 7td) 



1 + 7 

By induction, from (|2T]) and (|22l) . it follows that for every i > 

'7exp(icf) + exp(— ^td) 



Vt > 0. 



E 



exp 



(«£«« 



fc=i 



< 



1 + 7 



(22) 



(23) 



Combining dlOl and (l23l . followed by an optimization of the bound on P(m&xi< k < n (X k — Xq) > an) over t > 0, 
gives that 



max (Xfe 

Kfc<n 



Xq) > an ] < exp ( —nD 



5 + 7 



1 + 7 



7 



1 + 7 



Applying (1241 to the martingale {— X k , J-fcjfceNo 

gives the same bound on P(mini</ c < n (^\T/u — ^Q) 

arbitrary a > 0. The union bound implies that 



[ max \X k — Xq\ > an ) 

yi<fc<n J 



< 



max (Xt. — Xq) > an ) + 

Kk<n ' 



mm (X fc -Xo) < 

Kk<n 



< 



-an 



(24) 
-an) for an 

(25) 



This doubles the bound on the right-hand side of (l24b . thus proving the exponential bound in Theorem [2] 

In order to prove Theorem[T]for a discrete-time, real-valued and conditionally symmetric martingale with bounded 
jumps, we deviate from the proof of Theorem [2] This is done by a replacement of Bennett's inequality for the 
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conditional expectation in (1221 with a tightened bound under the conditional symmetry assumption. To this end, 
we need a lemma to proceed. 

Lemma 1: Let X be a real-valued RV with a symmetric distribution around zero, a support [—d, d], and assume 
that E[X 2 ] = Var(X) < -yd 2 for some d > and 7 G [0, 1]. Let /i be a real- valued convex function, and assume 
that h(d 2 ) > h(0). Then 

E[h(X 2 )] < (1 - 7 )/i(0) + ~fh(d 2 ) (26) 
where equality holds for the symmetric distribution 

f(X = d) = F(X = -d) = 1, P(X = 0) = l-7. (27) 



Proof: Since h is convex and supp(X) = [-d,d], then a.s. h(X 2 ) < h(0) + (§) 2 (h(d 2 ) - h(0)). Taking 
expectations on both sides gives (|26l ), which holds with equality for the symmetric distribution in ( f27T ). ■ 

Corollary 3: If X is a random variable that satisfies the three requirements in Lemma Q] then, for every A£fi, 

E[exp(AX)] < 1 + 7 [cosh(A(i) - l] (28) 

and (|28T ) holds with equality for the symmetric distribution in Lemma [T] independently of the value of A. 

Proof: For every A G R, due to the symmetric distribution of X, E[exp(AX)] = E[cosh(AX)] . The claim 
now follows from Lemma Q] since, for every x G R, cosh(Ax) = fo(x 2 ) where = ^^Lq A (2n)l is a convex 
function (h is convex since it is a linear combination, with non-negative coefficients, of convex functions), and 
h(d 2 ) = cosh(Xd) > 1 = h(0). M 

We continue with the proof of Theorem Q] Under the assumption of this theorem, for every k G N, the random 
variable = X& — X^-i satisfies a.s. E[^ | Tk-l\ = and E[(^) 2 | Tk-i] < cr 2 . Applying Corollary [3] for the 
conditional law of given F^-i, it follows that for every k G N and i 6 R 

E [exp(t&) I J-fc-i] < 1 + 7 [cosh(td) - 1] (29) 

holds a.s., and therefore it follows from (l2Tb and (1291 that for every t£l 



E 



expU^Cfc J 
^ fc=i ^ 



< (l + 7[cosh(td) - 1] ) . (30) 



Therefore, from (|20l , for every i > 0, 



max {Xk — Xq) > anj < exp(— ant)^l + 7[cosh(td) — l] J . (31) 
From © and a replacement of td with x, then for an arbitrary a > and n G N 

Pf max (X k -X Q ) > an) < inf f exp (-n\Sx - ln(l + 7[cosh(x) - l] )])} . (32) 

\l<fc<n / x>0 LVL J /J 

An optimization over the non-negative parameter x gives the solution for the optimized parameter in ([5]). Applying 
(l32l to the martingale {— X^, J^jfcgNo gives the same bound on P(minKfc< n (Xfc — Xq) < —an). Finally, using 
the union bound in (T25T ) completes the proof of the exponential bound in Theorem [T] 

Proof for the asymptotic optimality of the exponents in Theorems |7] and |2j In the following, we show that under 
the conditions of Theorem [TJ the exponent E(j, 5) in (§]) and © is asymptotically optimal. To show this, let d > 
and 7 G (0, 1], and let U\, U2, ■ ■ ■ be i.i.d. random variables whose probability distribution is given by 

F(Ui = d) = F(Ui = -d) = |, F(Ui = 0) = 1 - 7, ViGN. (33) 

Consider the particular case of the conditionally symmetric martingale {X n , Tn}.^^, in Example Q] (see Section ILBTi 
where X n = Y17=l for n. G N, and Xq = 0. It follows that \X n — X n _i| < <i and Var(X n | F n -i) = yd 2 a.s. for 
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every n G N. From Cramer's theorem in R, for every a > E[J7i] = 0, 



lim - lnP(X n - X > an) 

n— >oo n 

1 (\ U 

= lim - InP ~y^Ui > a 

n->co n \ n ' 



-/(a) (34) 



where the rate function is given by 



/(a) = sup {to - lnE[exp(t[/i)]} (35) 

t>o 

(see, e.g., (6l Theorem 2.2.3] and [0 Lemma 2.2.5(b)] for the restriction of the supermum to the interval [0, oo)). 
From (l33l and (1351 . for every a > 0, 

/(a) = sup {to — ln(l + 7[cosh(td) — 1]) } 

but it is equivalent to the optimized exponent on the right-hand side of d3T| ), giving the exponent of the bound in 
Theorem Q] Hence, 1(a) = £'(7, 5) in (0]) and ([5]). This proves that the exponent of the bound in Theorem Q] is 
indeed asymptotically optimal in the sense that there exists a discrete-time, real-valued and conditionally symmetric 
martingale, satisfying the conditions in dT) a.s., that attains this exponent in the limit where n — > 00. The proof for 
the asymptotic optimality of the exponent in Theorem [2] (see the right-hand side of ©) is similar to the proof for 
Theorem [1] except that the i.i.d. random variables U\, U2, ■ ■ ■ are now distributed as follows: 

F(Ui = d) = -l—, F(Ui = -jd) = — j— , ViGN 
1+7 1+7 

and, as before, the martingale {X n ,J r n } nl =fq is defined by X n = Ya=i^ = &{U\, ■ ■ ■ , U n ) for every 

n G N with Xq = and To = {0, 0} (in this case, it is not a conditionally symmetric martingale unless 7 = 1). 

B. Proof of Theorem \3\ 

The starting point of the proof of Theorem [3] relies on d20l ) and (I2TT) . For every k G N and t e 1, since 
^[^k 1 I ^fe-i] = f° r ever Y ' ^ N (due to the conditionally symmetry property of the martingale), 

E[exp(^ fc )|J- fc _i] 

^ t^E[^|^-i] ^ t 21 E [# I 7*-!] 



(20! ti (20! 



(20! £| (2/)! 

- + C97M + Z^ 



(20! tt (20! 



x ^ (to?) 2 ' ( 72 ; - 7m ) 

= 1+2^ ^TJ] + 7m(cosh(id) - 1) (36) 

where the inequality above holds since |%-| < 1 a.s., so that < . . . < 7™ < . . . < 74 < 72 < 1, and the last 
equality in d36l ) holds since cosh(x) = J2T=o (f^JT f° r ever y x £ ^- Therefore, from (|2"T1) . 



E 



exp (t £ f fc ) ] < f 1 + £ N)2 ' ( ( g, 7m) + 7™ [cosh(^) - 1] J (37) 



for an arbitrary t G R. The inequality then follows from (l20l ). This completes the proof of Theorem [3] 
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C. A Combined Proof of Theorems |4] and \5\ 

The proof of Theorem @] relies on the proof of the known result in Theorem [5J where the latter dates back to 
Freedman's paper (see (U Theorem 1.6], and also |6 ( Exercise 2.4.21(b)]). The original proof of Theorem [5J (see [8, 
Section 3]) is modified in a way that facilitates to realize how the bound can be improved for conditionally symmetric 
martingales with bounded jumps. This improvement is obtained via the refinement in ( f29T > of Bennett's inequality 
for conditionally symmetric distributions. Furthermore, the following revisited proof of Theorem [5J simplifies the 
derivation of the new and improved bound in Theorem [4] for the considered subclass of martingales. 

Without any loss of generality, lets assume that d = 1 (otherwise, {Xk} and z are divided by d, and {Qk} and 
r are divided by d 2 ; this normalization extends the bound to the case of an arbitrary d > 0). Let S n = X n — Xq 
for every n G No, then {S n , J^lneNo * s a martingale with Sq = 0. The proof starts by introducing two lemmas. 

Lemma 2: Under the assumptions of Theorem [5J let 

U n ±exp(\S n -0Q n ), Vne{0,l,...} (38) 

where A > and 9 > e x — A — 1 are arbitrary constants. Then, {U n , .Fn/neNo i s a supermartingale. 

Proof: U n in d38l ) is F n -measurable (since Q n in ( [TBI is J^-i-measurable, where T n -\ C F n , and S n is 
J^-measurable), Q n and U n are non-negative random variables, and S n = 2^2k=i £k < n a.s. (since ^ < 1 and 
So = 0). It therefore follows that < U n < e Xn a.s. for X,0 > 0, so U n £ L 1 (Q,J r n ,F). It is required to show that 
E[{7 n |.F n _i] < C/ n _i holds a.s. for every n G N, under the above assumptions on the parameters A and in (I38T ). 



(b) 



= exp(-6>Q n ) exp(AS' n _i)E[exp(A^ n ) | J" n _i] 



exp(AS' n _i) exp (-0(Q„_i +E[£\T n - 1 ])) E[exp(Ae„) | Jk-i] 
(c) TT ( E[exp(Ag ra ) l-Fn-i] \ 

-^-^exp^l^-i]) J (39) 

where (a) follows from (l38l) and because Q n and 5 n _i are J^-i-measurable and S n = 5 n -i + £„, (b) follows 
from (fl"3l . and (c) follows from d38l) . 

A modification of the original proof of Lemma [2] (see (8] Section 3]) is suggested in the following, which then 
enables to improve the bound in Theorem [5j for real- valued, discrete-time, conditionally symmetric martingales with 
bounded jumps. This leads to the improved bound in Theorem @] for the considered subclass of martingales. 

Since by assumption £ n < 1 and E[£ n | F n -\] = a.s., then applying Bennett's inequality in (1221 to the conditional 
expectation of e A ^™ given T n -i (recall that A > 0) gives 

wl ( , e ,, T 1 ^ exp(-AE[^| J- W _x]) +E[ff | J^i] exp(A) 
E[ex P (A^) I^J < 1 + E^I^] 

which therefore implies from d39l ) and the last inequality that 

wlrr , T f exp (~(A + g) E[g2 | J^]) E[g | J^i] exp(A - 0E[g | J^]) \ 

E L/ n y-„-i < t/ n -i Iic , rrtlr — i 1 : , wu2 1 ^ — i • (4U) 

In order to prove that "£,[U n \F n ^\\ < f/ n _i a.s., it is sufficient to prove that the second term on the right-hand side 
of d40l) is a.s. less than or equal to 1. To this end, lets find the condition on A, 9 > such that for every a > 

(tt^) ex p(-«( A + °)) + (tt^) exp(A " a9) - 1 (41) 



which then assures that the second term on the right-hand side of (1401 ) is less than or equal to 1 a.s. as required. 
Lemma 3: If A > and 9 > exp(A) — A — 1 then the condition in (|4~TT) is satisfied for every a > 0. 
Proof: This claim follows by calculus, showing that the function 

g(a) = (1 + a) exp(a#) — aexp(A) — exp(— aX), Va > 

is non-negative on M + if A > and 9 > exp(A) — A — 1. I 
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From d40l ) and Lemma[3j it follows that {U n , .FnlneNo * s a supermartingale if A > and 9 > exp(A) — A — 1. This 
completes the proof of Lemma 12 ■ 

At this point, we start to discuss in parallel the derivation of the tightened bound in Theorem @] for conditionally 
symmetric martingales. As before, it is assumed without any loss of generality that d = 1. 

Lemma 4: Under the additional assumption of the conditional symmetry in Theorem |4] then {U n , Fn}neN i n 
(|38T ) is a supermartingale if A > and 9 > cosh(A) — 1 are arbitrary constants. 

Proof: By assumption £ n = S n — £ n _i < 1 a.s., and £ n is conditionally symmetric around zero, given T n -\, 
for every n € N. By applying Corollary [3] to the conditional expectation of exp(A£ n ) given T n -\, for every A > 0, 

E[exp(A£ n ) | Tn-i] < 1 + n& | Fn-i] (cosh(A) - l). (42) 

Hence, combining ( f39b and (l42l gives 



■p.^j<^ 1 ( i+ ^ | f^^ ) - i n . 

y exp(0E[&|.F n _i]) J 

Let A > 0. Since E[£^ | J>i-i] > a.s. then in order to ensure that {U n , J>i}neN forms a supermartingale, it is 
sufficient (based on d43l ) that the following condition holds: 

1 + a(cosh(A) - l) 

V 77T ; "<1> Va>0. (44) 

Calculus shows that, for A > 0, the condition in (|44)) is satisfied if and only if 

6 > cosh(A) - 1 = 6 min {\). (45) 

From (l43l) . {f/nj-^njneNo i s a supermartingale if A > and ^ > # m i n (A). This proves Lemma 01 ■ 
Hence, due to the assumption of the conditional symmetry of the martingale in Theorem [4] the set of parameters 
for which {U n , F n } is a supermartingale was extended. This follows from a comparison of Lemma |2] and |4] where 
indeed exp(A) — 1 — A > # m in(A) > for every A > 0. 

Let z, r > 0, A > and either 8 > cosh(A) — 1 or 9 > exp(A) — A — 1 with or without assuming the conditional 
symmetry property, respectively (see Lemma [2] and [4]). In the following, we rely on Doob's sampling theorem. To 
this end, let MeN, and define two stopping times adapted to {T n }. The first stopping time is a = 0, and the 
second stopping time /3 is the minimal value of n G {0, . . . , M} (if any) such that S n > z and Q n < r (note that 
S n is F n -measurable and Q n is T n -\ -measurable, so the event {/3 < n} is T n -measurable); if such a value of n 
does not exist, let ft = M. Hence a < ft are two bounded stopping times. From Lemma |2] or |4] {U n ,T n } n ^o i s 
a supermartingale for the corresponding set of parameters A and 9, and from Doob's sampling theorem 

E[U p ] < E[U ] = 1 (46) 

(So = Qo = 0, so from (|38l ), Uq = 1 a.s.). Hence, it implies the following chain of inequalities: 

P(3 n < M : S n >z,Q n < r) 
= nSp>z,Q p <r) 

< F(AS^ - 9Q P >Xz- 9r) 
(c) E[exp(AS /3 - OQp)] 
exp(Az — Or) 

exp(Az — Or) 

<exp(-(Az-(9r)) (47) 
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where equality (a) follows from the definition of the stopping time (3 G {0, . . . , M}, (b) holds since A, 6 > 0, (c) 
follows from Chernoff's bound, (d) follows from the definition in (l38l ). and finally (e) follows from (l46l ). Since 
(14"7T ) holds for every M G N, then from the continuity theorem for non-decreasing events and ( |4"7T ) 

P(3n G N : S n > z,Q n < r) 

= lim P(3 n < M : S n > z,Q n <r) 
M-»oo 

< exp(-(A*-0r)). (48) 

The choice of the non-negative parameter 6> as the minimal value for which (l48l is valid provides the tightest bound 
within this form. Hence, without assuming the conditional symmetry property for the martingale {X n , F n }, let (see 
Lemma |2]) 9 = exp(A) — A — 1. This gives that for every z, r > 0, 

P(3n G N : S n > z, Q n < r) < exp(-[\z - (exp(A) - A - l)r]V VA > 0. 

The minimization w.r.t. A gives that A = In (l + p), and its substitution in the bound yields that 

z 2 _ (z 



F(3n G N : S n > z,Q n < r) < exp I -— • B (J 1 (49) 

where the function B is introduced in (fTTT ). 

Furthermore, under the assumption that the martingale {X n , T n } n ^ is conditionally symmetric, let 8 = # m i n (A) 
(see Lemma 0]) for obtaining the tightest bound in (l48l for a fixed A > 0. This gives the inequality 



P(3n e N : S n >z,Q n <r)< exp(- [Xz - r min (A)]) , 



VA > 0. 



The optimized A is equal to A — sinh 1 ( ^ J ■ Its substitution in (1451 ) gives that $ m i n (A) = Jl + $ - 1, and 



P(3nGN: S n > z, Q n < r) < exp (~ ■ c(^) ) (50) 

where the function C is introduced in ( fT51 ). 

Finally, the proof of Theorems |4] and [5] is completed by showing that the following equality holds: 

A = {3 n G N : S n > z, Q n < r} 

= {3 n G N : max S k >z,Q n <r} = B. (51) 

l<k<n 

Clearly A C B, so one needs to show that B C A. To this end, assume that event B is satisfied. Then, there exists 
some n G N and k G {1, . . . ,n} such that > z and Q n < r. Since the predictable quadratic variation process 
{Qn}neNo i n CD i s monotonic non-decreasing, then it implies that Sk > z and Qk < r; therefore, event A is also 
satisfied and B C. A. The combination of (l50l and (f5TT > completes the proof of Theorem |4l and respectively the 
combination of d49l and ( TSTb completes the proof of Theorem [5] 

We prove in the following Corollaries [T] and [2] that extend, respectively, Theorems [T] and |4] to real- valued discrete- 
time conditionally symmetric sub/ supermartingales. 

D. Proof of Corollary \J} 

The proof of Corollary Q] is similar to the proof of Theorem [T] The only difference is that for a supermartingale, 
Xk — Xq = ^2j = i(Xj — Xj-i) < Ylj=i Vj a - s -> where rjj = Xj — K[Xj \ Fj-i] is Tj -measurable. Hence 

k 



9 f max Xk — Xn > an ] < P ( max > m > an \ 

\Kk<n J- ll<K»^' J - / 

\ - - j=1 / 



where a.s. rjj < d, K[rjj \ Tj-i] = 0, and Yar(nj \ < a 2 . The continuation of the proof coincides with the 

proof of Theorem Q] for the martingale (X^jLi ^ji^fc/ifceNo (starting from d20T ) and (|30l). Since % < d a.s., then 
Xk — Xq < nd a.s. for every k G {1,. . . ,n}; hence, if (5 > 1 (i.e., a > d), then the probability on the left-hand 
side of ( fT9l ) is equal to zero. The other inequality for submartingales holds due to the fact that if {X^, F^} is a 
conditionally symmetric submartingale, then {— Xk, Fk} is a conditionally symmetric supermartingale. 
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E. Proof of Corollary [2] 

Since {X n ,T n } n ^ is a supermartingale, then a.s., for every k G N, X k — Xn < Ylj=iVj where, as before, 
rjj = Xj — K[Xj | Tj-i]. Consider the martingale {Y n , -^njneNo where Y n = Ylj=i Vj f° r every n G N, and Yn = 
(it is a martingale since a.s. E[r/j | Fj-i] = 0). Since Y^ — Yfc_i = r/fc for every fesN, then the predictable quadratic 
variation process {Q n }neN which corresponds to the martingale {Y n , J^jneNo i s > from ( fT3T ), the same process as 
the one which corresponds to the supermartingale {X n , .Fri/neNo- Furthermore, Xfc — Xn < J2j=i£j = Yk~Yn 
for every k G N. Hence, it follows that for every z, r > 0, 

P(3 n G N : max (X k - Xn) > z, Q n < r) < p( 3 n G N : max (Y fc - Y~ ) > z, Q n < r). 

V l<fc<n / V l<fe<n / 

Theorem |5J applied to the martingale {Y n , J>i}neNo' gives the bound in ( fT6l ) and ( fTTT ). If J>i}neNo i s a 
conditionally symmetric supermartingale, then {Y n , FnlneNo i s a conditionally symmetric martingale. In this case, 
applying Theorem |4] to the martingale {Y n , T n } n ^n gives the improved bound in (fl4l ) and ( fT5l ). 

Acknowledgments. I thank Ofer Zeitouni for his help in improving the presentation of the results, and for a 
suggestion that led to a weakening of assumptions in Lemma Q] 
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